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(57) Abstract: Embodiments of the invention relate to methods and systems for providing customized "haptic messaging" to users 
of handheld communication devices (1 10) in a variety of applications. In one embodiment, a method of haptic messaging includes: 
receiving an input signal associated with an actuation of a user-interface member (112); determining a haptic code associated with 
the actuation; and including the haptic code in an output signal to be sent to a remote handheld communication device (10). In 
another embodiment, a method of haptic messaging includes: receiving an input signal; outputting a request relating to a contact 
with a user-interface member (112) coupled to a handheld communication device (110); and providing a control signal associated 
^ with the contact to an actuator (130) coupled to the handheld communication device (110), the control signal being configured to 
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the scope of the invention in any manner. One skilled in the art would also recognize that 
various changes and modifications can be made herein, without departing from the principles 
and scope of the invention. 

FIG. 1 depicts a block diagram of a handheld communication device 100 according to 
an embodiment of the invention. It will be appreciated that various elements are shown in 
schematic form for illustrative purposes and are not drawn to scale. It will also be 
appreciated that many alternative ways of practicing the present invention exit. Accordingly, 
various changes and modifications may be made herein, without departing from the 
principles and scope of the invention. 

Device 100 includes a device body including a housing 110 and a user-interface 112; 
a processor 120; at least one actuator 130 in communication with processor 120; and a 
memory 140 in communication with processor 120. Device 100 also includes an antenna 150 
and a transceiver 160, in communication with processor 120. Device 100 additionally 
includes a display module 170 and an audio module 180, in communication with processor 
120. Display module 170 may include, for example, a liquid crystal device. Audio means 
180 may include, for example, a speaker, a microphone, and the like. 

For purpose of illustration in the embodiment of FIG. 1, processor 120, actuator 130, 
and memory 140 are shown to be enclosed within and coupled to the device body. Such an 
illustration, however, should not be construed as limiting the scope of the invention in any 
manner. In alternative embodiments, actuator 130 may, for example, be coupled to the 
outside of housing 110, or embedded in housing 110 via a suitable mechanism. Further, user- 
interface 112 may include one or more user-interface members. As used herein, a user- 
interface member includes, without limitation, a key pad having one or more keys, one or 
more buttons, a touch screen or touch pad, a scroll wheel, a direction pad, a trackball, a knob, 
a miniature joystick, or other user-interface means known in the art 

Device 100 further includes an API (Application Program Interface) 190, working in 
conjunction with an operating system 195. A device driver (not shown) may optionally 
provide an interface between operating system 195 and processor 120. 

Memory 140 of device 100 stores a program code that includes instructions to cause 
processor 120 to perform various tasks. The following description provides some examples. 

FIG. 2 shows a flowchart 200 depicting a method of using customized haptic effects 
to convey information to users of handheld communication devices, according to an 
embodiment of the invention. At step 210, an input signal associated with an event is 
received. At step 220, a source of the event is determined and a control signal is selected 
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configured according to a predetermined scheme or protocol that includes, for example, a 
table of haptic codes (some of which may be associated with one or more haptic logos) versus 
control signals for rendering the corresponding haptic effects. In this way, a processor in the 
handheld communication device can look up the corresponding control signal from the table 
based on the extracted haptic code, and output the selected control signal to the actuator for 
rendering the desired haptic effect. 

In the embodiments of FIG. 2 or 3, the handheld communication device (or the haptic , 

* * 

code) may be programmed such that the haptic effect is output immediately, or at a 
prescribed time after receiving the input signal, as desired in applications. The haptic effects 
can also be triggered by, or synchronized with, other occurrences. 

A handheld communication device may be further configured such that some of its 
user-interface members (such as those described above) are each associated with a haptic 
code, e.g., according to a predetermined scheme or protocol. In one embodiment, some of 
these haptic codes may be associated with haptic effects that emulate expressions or 
behaviors, such as "laugh," "giggle," "hug," "high-five," "heartbeat," "pet purring," etc. This 
allows haptic effects to be transmitted and experienced, e.g., in an interactive conversation or 

a chat session, by pressing or manipulating such members. 

■ 

By way of example, suppose that user A (termed "Alice" herein) is engaged in a chat 
session with user B (termed "Bob" herein) via their respective mobile phones. In one 
embodiment, when Bob tells Alice a joke, Alice can respond by sending a "laugh" sensation 
to Bob, e.g., by pressing a key on her mobile phone that is assigned with a haptic code 
corresponding to a laugh sensation. This causes a signal to be transmitted from Alice's phone 
to Bob's phone, and a corresponding haptic effect to be output to Bob's phone (and thereby 
experienced by Bob). In alternative embodiments, Alice can include a haptic code in an 
outgoing message (which may also contain a video image such as a picture taken by her 
mobile phone, and/or a graphical feature such as an emoticon emulating a smiley face) to be 
transmitted to Bob, e.g., by pressing the corresponding user-interface member. The haptic 
code causes a haptic effect to be output when the message is delivered to a remote device 
such as Bob's mobile phone. In one embodiment, the haptic effect may be correlated or 
synchronized with the displaying of a video image contained in the message. In another 
embodiment, the generation of the haptic effect based on the haptic code may be carried out 
in a manna* similar to that described above with respect to the embodiment of FIG. 3. 

. FIG. 4 depicts a flowchart 400 illustrating a method of a method of haptically 
encoding communication signals, according to an embodiment of the invention. At step 410, 
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effect may include one or more pulse or jolt sensations, where the number of pulses is 
proportional to the number of miles between the position of the handheld device and the 
destination. 

Processors described above (including processor 120 of FIG. 1) can include, for 
example, one or more digital logical processors capable of processing input, execute 
algorithms, and generate output as necessary to perform various tasks, such as those 
described above. Such processors/controllers may include a microprocessor, an Application 
Specific Integrated Circuit (ASIC), and state machines. Such processors include, or may be 
in communication with, media (including memory 140 of FIG. 1). Such media include, for 
example, computer readable media, which stores program code that, when executed by a 
processor, cause the processor to perform the steps described herein. Embodiments of 
computer-readable media include, but are not limited to, an electronic, optical, magnetic, or 
other storage or transmission device capable of providing a processor, such as the processor 
in a web server, with computer-readable instructions. Other examples of suitable media 
include, but are not limited to, a floppy disk, CD-ROM, magnetic disk, memory chip, ROM, 
RAM, ASIC, configured processor, all optical media, all magnetic tape or other magnetic 
media, or any other medium from which a computer processor can read. Also, various other 
forms of computer-readable media may transmit or carry instructions to a computer, 
including a router, private or public network, or other transmission device or channel. 

Program code and associated application programs related to various applications may 
also reside on a remote source, such as a network resource, a Web server, a remote handheld 
communication device or computer, which can be transmitted or downloaded to a handheld 
communication device on a regular or predetermined basis. Haptic effects (along with 
associated control signals) can also be downloaded or transmitted from a remote source, as 
described above. 

Actuators described above (including actuator 130 shown in FIG. 1) can include, for 
example, a pager motor, an eccentric rotating motor, a harmonic eccentric rotating motor, a 
voice coil, a solenoid, a resistive actuator, a piezoelectric actuator, an electro-active polymer 
actuator, or other types of active/passive actuators suitable for generating haptic effects. U.S. 
Patent Nos. 6,429,846 and 6,424,333 disclose further details relating to some of these 
actuators, both of which are incorporated in full herein by reference. In some embodiments, 
one or more actuators may be implemented in a handheld communication device, configured 
to deliver appropriate haptic effects. It will be appreciated that various control schemes can 
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That which is claimed is: 

1. A method, comprising: 

receiving an input signal associated with an actuation of a user-interface member; 
determining a haptic code associated with the actuation; and 
including the haptic code in an output signal. 

2. The method of claim 1 further comprising sending the output signal to a remote 
handheld communication device. 

3. The method of claim 1 further comprising including in the output signal at least one 
of a message, a video image, and a graphical feature. 

4. The method of claim 1 further comprising making the determination is based on a 
predetermined scheme. 

5. The method of claim 1 wherein the user-interface member includes at least one of a 
key, a button, a key pad, a direction pad, a touch screen, a scroll wheel, a mini-joystick, a 
trackball, and a knob. 

6. A method, comprising: 
receiving an input signal; 

outputting a request relating to a contact with a user-interface member coupled to a 
handheld communication device; and 

providing a control signal associated with the contact to an actuator coupled to the 
handheld communication device, the control signal configured to cause the actuator to output 
a haptic effect associated with the input signal. 

7. The method of claim 6 further comprising extracting a haptic code from the input 
signal, the control signal being based at least in part on the haptic code. 

8. The method of claim 6 further comprising causing a content of the input signal to be 
displayed, the content includes at least one of a message, a video image, and a graphical 
feature. 

9. The method of claim 6 wherein the user-interface member includes one of a key, a 
button, a key pad, a direction pad, a touch screen, a scroll wheel, a mini-joystick, a trackball, 
and a knob. 

10. A computer-readable medium on which is encoded program code, comprising: 
program code for receiving an input signal associated with an actuation of a user- 
interface member; 

program code for determining a haptic code associated with the actuation; and 
program-code -for including^&e-haptic-code in an output-sig£al— 
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